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ASSUMING THAT SPEECH IS THE RESULT OF A NUMBER OF 
discrete neuromuscular events AND THAT THE BRAIN CAN STORE 
ONLY A LIMITED NUMBER OF MOTOR COMMANDS WITH WHICH TO CONTROL 
THESE EVENTS, THE RESEARCH REPORTED IN THIS PAPER WAS 

directed to a determination of the size and nature of the 

STORED ITEMS AND AN EXPLANATION OF HOW SPEAKERS ENCODE A 
SEQUENCE OF THESE DISCRETE LINGUISTIC UNITS INTO A 
CONTINUOUSLY CHANGING SIGNAL. THE TECHNIQUE OF 
ELECTROMYOGRAPHY WAS USED TO STUDY THE ACTIONS OF SOME OF THE 
muscles in the mouth in ARTICUuAfiNG "S,P,D” COMBINED WITH 12 
AMERICAN ENGLISH VOWELS. RESULTS SHOWED THAT NO ONE-TO-ONE 
CORRESPONDENCE EXISTS BETWEEN PHONEMES AND MOTOR COMMANDS. 

TWO MOTOR COMMANDS DIRECTED SIMULTANEOUSL Y TO THE SAME MUSCLE 
RESULT IN MUSCULAR ACTIVITY EQUAL TO THAT NECESSARY FOR THE 
PRODUCTION OF THE SOUND REQUIRING THE GREATEST TENSION. IF 

MOTOR Commands call for a sequence of gestures and the first 

GESTURE REQUIRES MORE MUSCLE ACTION THAN THE SECOND, THE 
ACTION FOR THE SECOND GESTURE IS DECREASED. HOWEVER, WHEN THE 
SECOND GESTURE REQUIRES A GREATER OR EQUAL AMOUNT OF 
ACTIVITY, A MORE OR LESS SIMPLE CONCATENATION OF GESTURES 
RESULTS. ALTERNATIVE HYPOTHESES ARE DISCUSSED TO ACCOUNT FOR 
THESE DATA AND ARE SUGGESTED AS TOPICS FOR FURTHER 
EXPERIMENTS. THIS PAPER WAS PRESENTED AT A MEETING OF THE 
ACOUSTICAL SOC. OF AMER., BOSTON, JUNE 1, 1966. (JD) 
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Paper to be given at meeting of Acoustical Soc5.ety of America, June 1. 
'VICToPiA A, U.C.,L,A. . Boston, VaDS, 

R ela t i o n s )i 1 r» between Liria:ii3 .stic Units and Motor Commands 
Before any useful model of speech performance can be constructed 
further research is required to provide more detailed knoi-^ledge than 
is now available about the encoding a.r?d decoding processes ’=jhich occur« 
It seems logical, however, to start with the assumption that the semi 
continuous acoustic signal that v/o call susech is the rcsu?^t of a 

number of discrete nsuromuscular events, V/e 

. \ 
niouor commands for every utterance that we may wish to say, owing to 

the brain's finite storage capacity. Speech then is produced by the 

rearrangement of a limited number of stored items. One of the problems 

to be resolved is the determinacicn of the size cind nature of the 

stored items, and to exnlaln how speakers encode ci sequence of these 

discrete linguistic units into a continuv~usly cnanging signal, V'e are 

assuming that at some previous level of brain activity some rrarr.matical 

and semantic unit of a sentence has been encoded into a series of 

discrete segments, which must be further encoded into signals elk to 

activate the muscles in such a way that snaech sounds arc produced- 

V/e have here a * black box' situation^ but one in which the only 

data we can examine is the ouputj i,s, the activity of the muscles,, 

I 

the articulatory gestures, and fina3.1y the acoustic signals V/e must 
make certain assumptions aboixt the in-out into the niobor comn’and 
mechanism i and about the transfornatiens which take ■^lace, V/e are 
unable to look into the speaker’s brain, and even if we did so, it is 
unlikely that this would reveal, the encoding mechanisBo 

Can we assume the input to be phonemes, such that there is a one-to- 
one mapping of phonemes or phon ’ - features onto individual motor 
commands? Our own investigations suggest that this is not the case. 






llL-irur the teohjiique of electro^j Ofraphy , a ctv.fy was ruh^'^o oi the 
actione of the orbiculai-is oris riuscle in the arcicula r.ioji of CVC 
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the mouth oponiTi,-:: has as its functions the closIn.T ard protrusion of 
the lirs.. It is therefore activated in i’. 'oriahial closure ana in 
the production oi* roun-ied vowels. The action v.otentialei recordea 
by an electroc?e placed over this tTiUScie, cf tv-enty tokens ox eacn 
utterance were averared usIas a LIhC pur-'O-.e conn'iii^er- 

V/e. shall siin?:nari?.e some of the results of the study v/hich are 

rele^<ant to the encodln.c: process 

In -Che slides to be presented., the horizontal axis represents 
ta-a; a.l seoenrts of and the veriio'.l a.>ris tho recorded voltage 

in nicrovoits 0 

1, 'llo one-to-one corresrondyiicr; exists between tAonsires -and 
rrotoi' cor/iKcinds .. Slide io 

This demonstrates that tha lauscle act5.vity which j-.rodur.os 
an initial /b/ is of greater a:upl.itude and c.uraticn than thaa producing; 

a final /b/o 

This is further illustrated by Slice 1- 

Here one sees the .suterinipooiciort of a\eraged S?*.& tracu-a in 

initial .and'iinal /b/ utterances. It is ovi-^snt that !5i«2ES5.3fccso«te 

thare is no invariant motor oomwiaad for the ohoncEse /V inderendent oi 

context-. 

2^ The gesture res'--on 3 ible for ar. initial bilabial closure 

was ui 
all fcliG 

• • I. w 4* I”' ja pi t ! v f* r* 3 V* 0 C O Cl C 3. OH 

cJirfoi'tiuCG bGt'.?5eA aa xrrt'Lul / o/ ox x;l.e ^-.me u 

two 3 e P'3 rate occasions.. 

Slice 5- 

This slide shov;s the variation of orbicularis action which 



,-ia-t-oted by- the vowel which followed. The variability between 

of /b/ fcllov/?d by diCforent vowels u 
;liG iciti.al /b/ utterances vis i'ele-tix^Gly rx greater than ».he 
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occv.rs ifdriiirix between /bib/ utterances, and those between /bub/ and /bIb/<, 

It ie evident that tvjo motor comr.jands, if this is what occurs, 

# 

directed to the same muscle do not result in a simple addition of 
the number of motor units contracting^^ V'hen the motor commands call 
for the gestures to occur simultaneously, the resultant musculai' 
activity is equal to that necessary for the production of the sound 



reqi\iring the greatest tonsiono 

h’hen motor commandG call for 
first gestixre requires more muscle act 
the action for the second gesture is d 



a sequence of gestures, 
ion than the subsequent 
ccroased-j 



if the 



gesture. 



Slide 4 

Vievfing the suporinposition of /bud/ and /dud/ ElCi traces, and 

there is a 

/bod/ Vtit}i /clod/ traces, it is evident that a decrease of the muscle 
action associated v;ith the vowel when the vowel follows a consonant 
^iii which- there is greater e:cpend:lture of offorto Physio?i.op:ic£lly 
this is 9X];lairied by a simple inertial effect, that is, it is harder 
to start cn object moving than it is to keep it mo^^ing once it is 
started-. 



4o Finally, it v/as found that when motor commands call for a 
sequence of gestures, v;here the 

second gesture requires a greater or equal amount of activity, a more 
or less simple concatenation of gest^ires results. 

Slide 5 



Here you see the superiniposition of utterances in v;hich the 
vowel is /u/ and the final consonants /b/ and /d/. Little difference 
if any results from a final /b/ as ou’osed to final /d/:. 
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Alternative hypotheses are eizffrested to account for these data^ 

V/e can assume- that the input to the neuroniotor raachanisin j,s not a 

% 

sequence of phonemic segments bv.t of phonetic segments, alloph&nes> 
Such a proposal assumes thtxt there is stored in the brain a separate 



comraand for every possible aliophoneo It is logical to assume this 
to be the case for vmat Ladefcged has called extrinsic allophoneso 



those not rociiltiii^ frea coarticulatioa factors or overlapping commands. 



but vjhich require a different set of raotcr commands, such as is 
illustrated by the differences betvieen initial and final /b/« But 
fax intrinsic allophonas which are the result of immediate phonetic 
context may be processed and transmitted directly as signals to the 
musclesc Thus, the decrease in the muscular contractions for an /u/ 
preceded by a /b/ v/ould be the result of the previous n-uscular state. 

Hov^ the intrinsic allo-chones are processed., that is, how the 



neighboring sounds influence antecedent esr subsequent sounds also 

suggest a.lt.err>ative exol'-uiationso 

One can assume that k by a feedback mechanism the output xsxmxniiisnHd 
— , muscle state — is monitored, which information is sent bac’s to 



subsequent 

the motor command encoding devise to s chJHigc th s/o o mman ds . 



Egj'ssmqasnt However, the rauidity of the articulat^.on process, coupled 
with the delay time necessary for the proprioceptive feedback would 
'not pei'mlt feedback from the peripheral org'ans to modify the signals 
from the nervous system in timoo However, in cex’tain neural systems, 
the signals themselves may be monitored, that is, tho nervous system 
can look at the command rather than at the output and change a subsequent 



command in keening with the requirements to achieve the new gesture.? 

There is an alternative explanation; namely that the linguistic 
unit corresi-onding to individual sets of motor commands is not of the 
size of a pho»‘ene or allophone, but rather that of a syllable, or some 
A-r T*,v.rt»,dwj r» R#jcr?n#*ntp!« Much su o'oerting evidence for this 
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position has baen advancodo -'or* exawpD.e.j in a CV syllable, in which 

» 

the vowel is marked by a roundoi^i- feature, the protrusrlon occurs 
sirailtai:fs0usl;7 v;ith the Sirticulation of the consonant, and in soaie 
case even before© : 

The suggestion that the units for the articulatory progxvar. are 
syllable- type units is supported further by Kozhevnikov and Chxsfcovich 
in Leningrsid, whoss; Tjrovlde support for tha idea that syllable commands 
arc rhythmically orga-uised by a separate rhyth-n generator in the nervous 
system, distinct from the articuj.atory generator-. 

If this is the case., either one GX'St conclude that a raany-to«one 
encoding process occurs — *'• allophoties to syllaoxes ■*'— v/nxen nev/ unit.s 
ax*e snapped onto motor comniands? Alternatively , tns message may be 
originally encoded into un5.ts laiger than phon-omic segments^ i^et. syllable, 
It is c.oiiceivable that individual sets of motor commarxds corresT;onding 
to syll-ables are stored© It x vseetns more plausible that the syllable 
units are complex units encoded in rhoneiaic or allophonxc segments 
and these sub-syllabic units ar? mapped onto motor commands by the 
feedbe.ck n-sc'ianism siiggestod» This would require less storage canac?„tr/ 
and vjould explain the errors vihich occur in sneaking in which parts of 
syllables persevere or are anticipated,-. 

V7hi3.<^ the present stats of knov/ledge excludes ary deixnitive answers 
to the qiiestions raised, the alternativ-e suggestions do account for 
the data© Ucw data, and tha discovery of new relationshipo should 
pi'ovide the basix for eskh ^ possibly better explanations. We therefore 
view our suggestions as working hypotheses on v;hich to base further 
exuaritnants© 
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Relationship between Liiiffliiistic Units and Motor Commands 

Victoria A* Fromkin, U.C.L.A. 



!• Smamary of some of the results of an Electromyographic study of 

orbicularis oris muscle. Utterances were CVC aonosylJkables; 

C = /b,d/, V = /u,-?r ,i ,/ 

1. In utterances in which both and Cp = /d/i /d^d/, no 

muscle activity v/as r^coi-ded when V S /i/; muscle action potentials 
were recorded v;he 2 i V = /u/ and At/o 

2. In all utterances in which /b/ occurred, muscle activity was 
recorded; for initial /b/ the action potentials occurred 

prior to the onset of the audio signal, for final /fo/ the action 
potentials (AP) occurred after the onset of the audio signal. 

5o V/hen /b/ occurred initiallyg the muscle action was greater ia 
amplitude and duration than when /b/ occurred finallyn 

hro The muscle action associated v/ith an initial and final /b/ was 

unaffected by the quality of the vowel which preceded or followed it« 

5o The action potentials produced in the articulation of /dud/ 
i.e. of the vov*/el /u/ , started prior to the onset of audio 
and extended after the onset of audio. There \vas less 
muscle action after the onset of audio v/hen /u/ was preceded 
/^/ than v;hen /u/ v;as preceded by /d/. 

6. The muscle activity associated with /u/ and /zr/ v;as independent 
of the consonant which follov/ed, i.e. when follov/ed by a /b/ 
which also showed action potentials there v/as no difference than 
%fhen followed by a /d/ which shewed no muscle action n 

7o The omscle action potentials produced in the utterance /b^d/ 
v/ere relatively indistinguishable fro® that for /bid/. 
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